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Abstract 

We study the structure of nilpotent subsemigroups in the semigroup M(n, F) 
of all n x n matrices over a field, F, with respect to the operation of the usual 
matrix multiplication. We describe the maximal subsemigroups among the nilpotent 
subsemigroups of a fixed nilpotency degree and classify them up to isomorphism. We 
also describe isolated and completely isolated subsemigroups and conjugated elements 
in M(n,F). 

1 Introduction 

The structure and combinatorics of the classical finite transformation semigroups is now 
relatively well understood. A lot of information about such semigroups as the full finite 
inverse symmetric semigroup XS n , the full transformation semigroup T n and the semi- 
group VT n of all partial transformations on {1,2, ... ,n} can be found for example in 
the monographs |CP^ IHij IHol ILa[ iLi] or other numerous papers studying transformation 
semigroups. Two directions of study for transformation semigroups, which developed over 
the last 15 years, is the study of conjugated elements and nilpotent subsemigroups in 
these semigroups, which resulted into several nice structural and combinatorial results, see 
pOl IGK21 IGK31 [GKil IGTS1 iGMl [KM] . 

Certainly, the passage to infinite transformation semigroups completely changes the pic- 
ture. However, it is still possible to obtain some information under reasonable "finiteness" 
conditions. One of the most classical examples of an infinite object possessing several prop- 
erties, inherent in finite objects, is the algebra of all linear operators on a finite-dimensional 
vector space over a field. Forgetting the addition of linear operators one gets a semigroup, 
isomorphic to the semigroup M(n, F) of all n x n square matrices with coefficients from a 
field F with respect to the operation of usual matrix multiplication. This semigroup has 
also been studied by many authors, but so far not as intensively as the classical transfor- 
mation semigroups. Many interesting results about M(n, F) can be found in the recent 
monograph |Ok2] and in its references. 

The aim of the present paper is to contribute to the study of M(n, F) with results in 
several directions. The main emphasis is made on the study of conjugated elements and 
nilpotent subsemigroups of M(n,W). In the appendix we also address the problem of the 
study of isolated and completely isolated subsemigroups. These different directions are 
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not immediately related with each other, however, when combined together, they give a 
very nice illustration for the fact that in the passage from the classical transformation 
semigroups to matrix semigroups one should expect that some results would be transfered 
to very similar results, while some other results would sound quite differently. And even 
in the case of similar results, the passage to matrix semigroups substantially increases the 
level of technical difficulties. 

The notion of conjugated elements in group theory is very important and has a lot of 
applications (for example for the study of automorphisms, characters or representations). 
There are several ways to extend this notion for semigroups. Two most straightforward 
generalizations are: conjugation with respect to an invertible element, and the transitive 
closure of the ab ~ ha relation. Both these notions provide some invariant on semigroups 
and hence can be applied for the study of automorphisms, endomorphisms and represen- 
tation. The already existing literature, where these notions were studied (see for example 
[GK1| iLil IKM] ) suggests that the second generalization is more interesting than the first 
one. For M(n, F) the description of equivalence classes with respect to the conjugation 
by invertible matrices is a classical problem, the answer to which is given by the Jordan 
normal form of a matrix (in the case of an algebraically closed field) . In Section [2] of the 
present paper we describe the equivalence classes with respect to the transitive closure of 
the ab ~ ba relation. It turns out that these are given by the "invertible part" of the Jordan 
normal form. This is very similar to the results obtained in |GK1} IKM] for transformation 
semigroups. The results of Section[2]of the present paper and the results of [GKlllKM] were 
the main motivation for the abstract approach to the study of conjugation for semigroups, 
developed in [Kuj . 

The majority of the paper is devoted to the study of nilpotent subsemigroups of 
M(n,¥). To start with, we would like to remark that the notion of a nilpotent semi- 
group has been used in the literature in at least three different senses. The most classical 
one is the notion of nilpotent semigroup in the sense of Maltsev, |Maj . which is defined 
by means of the identities for nilpotent groups, rewritten without g~ x terms. The matrix 
semigroups, nilpotent in the sense of Maltsev, were recently studied in [Oklj . However, in 
this paper we are going to use another notion of a nilpotent semigroup, which comes from 
the ring theory. A semigroup, S, with the zero element is called nilpotent of nilpotency 
degree nd(S') = k provided that aia 2 ... = for any a\, . . . , a& G S while there exist 
G S such that b\ . . . bk-i ^ 0. This notion is almost as old as the first one and 
goes back at least till |Shevj . From now on we will use only the last notion of nilpotent 
semigroups. 

The study of nilpotent subsemigroups of certain semigroups of partial transformations, 
in particular, of the semigroup TS n , was originated in [GK4j . It happened that the com- 
binatorial data, describing the maximal nilpotent subsemigroups of finite transformation 
semigroups, is usually a certain partial order on the underlined set, on which the semigroup 
acts. This philosophy was successfully used later in [GK2| IGK3] and generalized on the 
infinite case in |Sh2[ IShl] . In [GTS] the combinatorial description of maximal nilpotent 
subsemigroups of 2S(M) was used to determine the group of automorphisms for these 
subsemigroups. 
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In the present paper we generalize this technique to study nilpotent subsemigroups 
of the semigroup M(n, F). A part of this study is very easy It is well-known that the 
maximal nilpotent subalgebras of M(n, F) correspond bijectively to complete flags in F n . 
An elementary exercise in linear algebra shows that a maximal nilpotent subsemigroup of 
M(n, F) is in fact a subalgebra. Hence maximal nilpotent subsemigroup of M(n, F) are 
also described by complete flags in F n . This is a perfect analogy with the combinatorial 
data describing maximal nilpotent subsemigroups in transformation semigroups. So, there 
is no problem to classify such subsemigroups, what we do in Section [31 where we also 
collect some other statement necessary for or main goal: to classify maximal nilpotent 
subsemigroups of M(n, F) up to isomorphism. At this point we face our main difficulty in 
comparison to finite transformation subgroups. The fact that the cardinality of M(n, F) is 
infinite for infinite F makes it impossible to distinguish non-isomorphic maximal nilpotent 
subsemigroups of M{n, F) by their cardinality, as it was done in case of TS n in |GK3j . 
Therefore we classify all maximal nilpotent subsemigroups of M(n, F) up to isomorphism 
in Section H] using completely different arguments. 

In the Appendix we classify all isolated and completely isolated subsemigroups of 
M(n, F) for finite F. This is not directly related to the main content of the paper, however, 
from our point of view, these results, especially for isolated subsemigroups, are not im- 
medeately expected, are non-trivial and again give a very nice (and not yet well-understood) 
illustration of similarity with the classical transformation semigroups. The results of the 
Appendix were also a part of the motivation for the study of isolated subsemigroups in the 
variant of T n , see [MTJ. 

2 Conjugated elements 

Let S be a monoid and G be its group of units. The elements x,y G S are said to be 
G-conjugated provided there exists g G G such that x = g~ x yg. This is denoted by 
x ~g V- The binary relation ~c is an equivalence relation on S. The elements a and b of 
a semigroup, S, are called primarily S -conjugated if there exist such x,y G 5* that a = xy 
and b = yx. The binary relation ~ p s of primary S-conjugation is reflexive and symmetric, 
but not transitive in general. We denote by ~s the transitive closure of this relation. If 
x ~5 y, the elements x and y will be called S -conjugated. Both ~ G and ~s generalize the 
notion of conjugated elements in a group, and in the general case the relations ~g and ~5 
do not coincide. However, ~g is always a subset of ~s. 

The group of units in M(n, F) is GL(n, F). If F is algebraically closed, then the de- 
scription of GL(n, F)-conjugated elements in M(n, F) is the classical Jordan theorem of 
the basic linear algebra: A ~GL(n.F) B if and only if the Jordan normal forms of A and B 
coincide (up to a permutation of Jordan cells). 

Let A G M(n,F). For each k > we have the inclusion F n D A k (¥ n ) D A k+1 (¥ n ) D 0, 
which implies n > dim(v4(F n )) > • • - > dim(j4 fc (F n )) > • • • > 0. Since only at most n of 
these inequalities can be strict, we can assert that, starting from some power t, we have 
^4*(F n ) = A t+,l (¥ n ) for each i > 0. Denote by A s the linear operator defined as follows: 
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A s (v) = A(v), v G A t (¥ n ); ker(A s ) = ker(A*). Remark that for an algebraically closed 
field, F, if we fix a Jordan basis for A, then A s is obtained from A by replacing all Jordan 
cells with eigenvalue by zero blocks. The main result of this section is the following. 

Theorem 1. Two matrices A and B from M(n, F) are M(n, ¥)- conjugated if and only if 
A s and B s are GL(n, F) -conjugated. 

Proof. Sufficiency. We start with the following lemma: 

Lemma 2. A ~M(n,F) A s for every A G M(n,¥). In particular, A ~m(ti,f) for every 
nilpotent A G M(n, F). 

Proof. Denote by V { = Im(^), i G N, V = ¥ n . Clearly, V { C K-i for all i. Let 
V( be a complement to V^, i G Z + , such that V/ = ker(v4*) for all i > t. Set = 
e(Vi, V{)Ae(Vi-i, V^_ t ). Then B x = A and B n = A s . Hence, to complete the proof it is 
enough to show that Bi ~ P A/(n,F) B i+X for all i. For a fixed i denote Ui = e(Vi,V-) and 
Vi = e(Vi, V7)-Ae(K--i, K-i) = Tnen u i v i = Vi = Bi. Moreover, 

v iUi = e(V h V!)Ae{Vi- U VU)<V h V() = 

= e(V h V-)Ae(Vi, V[) = e{V i+1 , V!^)Ae{V h V-) = B i+1 . 

□ 

Let A s and B s be GL(n, F)-conjugated. By Lemma [21 we have A ~M(n,F) A s and 
B ~M(n,F) -Bs- Hence the transitivity of the relation ~M(n,F) implies A ~M(n,F) -£>• 

Necessity. Clearly, it is enough to consider only the case when A and B are primarily 
M(n, F)-conjugated. So, let A = XF and B = YX for some X, F G M(n,F). Let 
Vi = Im(A n ), Wi = Im(B n ), V 2 = ker(A n ) and W 2 = ker(B n ). Then we have F n = 
V l ®V 2 = Wi® W 2 and 

rank(A n ) = rank(A l ) and rank(B n ) = rank(B l ) for all i > n. (1) 

Since Bikei(X)) = and B(Wi) = W x it follows that ker(X) n W x = 0, analogously 
ker(y) n Vi = 0. Let x G "V 2 . Then A n+1 x = XB n Yx = 0, and ker(X) n W x = 
forces Fx G W2, that is Y* : V2 — > W2. Analogously one shows that X : W2 — > V 2 . If 
x G Vi then x = A n x' for some x' G Vi since A n : Vi Vi is bijective by ([H). Hence 
Yx = YA n x' = B n Yx' G W x . This implies Y : Vi -> VFi and, analogously, X : Wi -> Vi. 
The equalities ker(X) n Wi = and ker(F) n Vi = now say that Y : Vi -> Wi and 
X : Wi — > Vi are bijections. In particular, 

Fe = /ye and Xf = eXf, (2) 

where e = e(Vi, V 2 ) and / = e(W\, W 2 ). 

Further, we have A s = eAe as the actions of these operators on both Vi and V 2 coincide. 
Analogously B s = fBf. Now from A s = eAe = eXYe, B s = fBf = fYXf and (E} we 
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derive A s = eXYe = eXfYe = eXffYe and B s = fYXf = fYeXf = fYeeXf, 
implying, in particular, that A s and B s are primarily M(n, F)-conjugated. 

The fact that Y induces a bijection from V\ to W\ implies that dim(Vi) = dim(Wi) and 
thus dim(V2) = dim(W / 2 ). Let Z be any matrix such that ker(Z) = V\ and Z : V 2 — > W 2 is 
a bijection, which exists since dim(V2) = diu^W^). Consider the matrix M = fYe + Z. We 
have M(Vi) = fYe{Vy) = W x since Z(Vy) = and M(V 2 ) = Z(V 2 ) = W 2 since e(V 2 ) = 0. 
Hence fYe + Z e GL(n, F). 

From the definition of Z we obtain fZ = Ze = 0, which implies 

B S M = fYeeXf(fYe + Z) = fYeeXffYe = (fYe + Z)eXffYe = MA S . 

Hence B s = MA S M~ X , which completes the proof. □ 

We would like to remark that, for an algebraically closed F, Theorem [1] provides a 
criterion of M(n, F)-conjugacy in terms of Jordan normal forms: A and B are M(n, ¥)- 
conjugated if and only if their Jordan normal forms coincide up to a permutation of Jordan 
cells and a replacement of some nilpotent Jordan cells by some other nilpotent Jordan cells. 

3 Nilpotent subsemigroups of M(n, F) 

The results of this section are mostly known or can be easily deduced from the existing 
literature. However, we did not manage to single them out in the literature in one piece 
and in the form we present them. Our presentation emphasizes the similarity with the 
corresponding results for transformation semigroups, see |GK2| IGK3} IGK4} IGMj . We 
include the proofs for the sake of completeness. 

Lemma 3. Let T be a maximal nilpotent subsemigroup of M(n,¥) . Then T is, in fact, a 
subalgebra of M(n,¥). 

Proof. Let T be a maximal nilpotent subsemigroup of M(n, F). Denote by T' the linear 
span of T inside M(n, F) . Then every element in T' is a finite linear combination of elements 
from T, and T C X". Since matrix multiplication is bilinear and T is a semigroup, we obtain 
that X" is in fact a subsemigroup of M(n, F). To complete the proof it is enough to show 
that X' is nilpotent, which follows immediately from the nilpotency of X and 

(mi \ / m s \ mi rn s 

E « )■■•(£ \': , «!: > )=£•-•£ • • ■ ■ ■ • «!:') ■ 
h=l / \i s =l / ii=l i«=l 

□ 

Nilpotent subalgebras of M(n, F) are classical objects both in algebraic geometry and 
in representation theory and have a natural description in terms of flags in F n . By a flag, 
T, in F n of length I (J 7 ) = k we will mean a filtration, T : = V C V x C • • • C V k = F n , 
of F n by subspaces, such that Vi 7^ Vi+i, i — 1, . . . ,k — 1. The tuple (c?i, . . . , d^), where 
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di = dim(Vi/Vi_i), will be called the signature of T and will be denoted by sig(jF). A 
basis, {v\, . . . , v n }, of F n is said to be an F-basis if Vi, . . . , fdim(Vi) is a basis of Vi for all 
i — 1, . . . , k. 

If 5* is a semigroup with and k > 2, we denote by Nk(S) the set of all nilpotent 
subsemigroups of 5* of nilpotency degree k. This is a partially ordered set with respect to 
inclusion and the set Ufc> 2 A^ fc (5') is the set of all (non-zero) nilpotent subsemigroups of S, 
which is also partially ordered with respect to inclusion. 

To each flag T in F n of length k, we associate the nilpotent subsemigroup ^(J 7 ) = 
{a G M(n, W)\a(Vi) C Vi-i for all i} of M(n, F) of nilpotency degree k. To each nilpotent 
subsemigroup S of M(n, F) of nilpotency degree k, we associate the flag ip{S) in F n defined 
as follows: C (S h ~ 1 (¥ n )} C (S k - 2 (¥ n )) C ••• C (S(¥ n )) C F n . The correctness of this 
definition follows from the following statement. 

Proposition 4. 1. If J 7 is a flag in F n of length k, then ^(J 7 ) is a nilpotent semigroup 
of M(n, F) of nilpotency degree k. 

2. If S is a nilpotent subsemigroup of M(n,¥) of nilpotency degree k, then ip(S) is a 
flag of F n . 

Proof. Obviously ^(J 7 ) is a nilpotent semigroup and ^p(J r ) k = 0. Let B = . . . , v n } 
be some JF-basis in F n . Consider the element a G M(n, F), defined on B as follows: 
o(fdim(Vi)) = t 'dim(v'i_i), i = 2, . . . , k, and a{vj) = otherwise. Then a(Vi) C V^_i by the 
definition and hence a G ^(J 7 )- But a fc_1 (t> n ) = fdim(Vi) an d hence a k ~ l ^ 0. This means 
that nd(<^(jF)) > k — 1 and thus equals k. This proves the first statement. 

Since aia 2 a 3 . . . a i+1 = (a 1 a 2 )a 3 . . . a i+1 we have S l+1 C S l and thus obtain the inclusion 
(S i+1 (¥ n )) C (^(F n )). Hence it is only left to prove that (^(F n )) ^ (S i+1 (¥ n )). But 
(S' t+1 (F n )) has a basis, consisting of elements from S , * +1 (F n ). Further, S k = implies 
S k ^ t ^ l (^S' l+1 (¥ n )) = and, using the fact that the elements from S are linear operators 
on F n , we obtain that S k ~ l ~ 1 ((S' l+1 (¥"))) = 0. To complete the proof it is now enough to 
show that S k - i ' 1 ((S i (¥ n ))) ^ 0. Since ^(F n ) C (^(F n )), it is even enough to show that 
S k ~ i ~ 1 (S i (¥"■)) ^ 0, which reduces to 5 fe_1 (F n ) ^ 0. The last inequality follows from the 
fact that nd(S') = k and therefore S k ~ 1 ^ 0. □ 

Proposition H] immediately implies the following classical results: 

Corollary 5. If S is a nilpotent subsemigroup of M(n,¥) , then nd(5) < n. 

Corollary 6. A subsemigroup, S C M(n, ¥), is nilpotent if and only if S consists of 
nilpotent elements. 

Lemma 7. 1. Let i G {2, . . . , k}. Then for every v G V^i and w G Vi-\ \ V^ 2 there 
exists a G ^(J 7 ) such that a(v) = w. 

2. cp(J 7 ) i (¥ n ) = Vfc_i for all i = 1, . . . , k. 

3. tp{T) is a subalgebra of M(n,¥) . 
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Proof. We can certainly find an .F-basis B of V such that both v and w belong to B. The 
linear operator a G M(n,¥), which sends v to w and annihilates all other elements of B, 
belongs to ^(J 7 ), which proves the first statement. The second and the third statements 



Let T be a flag in F n . We will say that sigjF is also the signature of the semigroup 
(p(J-)- Let k be a positive integer, k > 2. A nilpotent subsemigroup, S C M(n, F), is called 
k-maximal provided that S is a maximal element in Nk(S). 

Proposition 8. ^(J 7 ) ^ s k-maximal with k = 1{J-) and every k-maximal nilpotent sub- 
semigroup of M(n,¥) equals (piJ 7 ) for some flag, T , of¥ n of length k. 

Proof. Let S be a nilpotent semigroup of M(n, F) of nilpotency degree k. From the defini- 
tions of tp and if) it follows that S C tp(if>(S)). Hence any /c-maximal nilpotent subsemigroup 
of M(n, F) has to be of the form <f(J r ) for a flag, J 7 , of ¥ n of length k. 

Now assume that S = ^{J 7 ) C T, where T G 7V fe (M(n,F)). Then S i (¥ n ) = V k -i C 
T'(F n ) for all i and hence it is enough to prove that S i (¥ n ) = T i (¥ n ). Assume that j is 
minimal such that this equality fails. This means that there exists v G S j ~ 1 (¥ n ) = T j ~ 1 (¥ n ) 
and a G T such that a(v) G" S^F"). Consider a new flag, J 7 ', which has the form 



= V C V ± C • • • C V k -j C (T^'(F fe )) C c . . . 14 = F" 

For every % = 0, 1, . . . , k - 1, i ^ j - 1, pick ^ G ^(F") \ ,S i+1 (F n ). Then the set 



is linearly independent, as its components belong to the different subquotients of J 7 ', so 
we can extend this set to a basis, say B, of F™, coordinated with J 7 '. Now consider the 
elements a iy i ^ j — 2,j — 1, defined as follows: Oj(i>j) = and Oj(iu) = 0, w E B \ 
and elements 6, c, defined as follows: b(vj_ 2 ) = v, b(w) = 0, w E B \ {vj_ 2 }; c(a(v)) = Vj, 
c(w) — 0, w G B \ {a(v)}. It follows immediately that b, c and all Oj are elements of 
^(.F) and hence of T. But afe_2 . . . djcabajs . . . ai(fi) = Vk-i ^ and hence nd(T) > k, a 
contradiction. □ 

Corollary 9. TTie maps </; and if> are mutually inverse bisections between the set of k- 
maximal nilpotent subsemigroups of M(n, F) and the set of all flags in ¥ n of length k. 

We will say that a flag T is a consolidation of J 7 ' provided that each V( equals Vj for 
some j. In particular, if T is a consolidation of J 7 ' then either T = J 7 ' or Z(jF) > Z(JF'). 

Proposition 10. (fiJ 7 ') C v 9 (^ r ) if and only if J 7 is a consolidation of J 7 ' . 

Proof. The "if" part follows from the definition of ip. To prove the "only if" part we 
set S = tpiJ 7 '), T = ^(J 7 ) and actually have to show that for every i there is j such 
that S l (¥ n ) = T j (¥ n ). Assume that this is not the case and let i be minimal with this 
property. From S C T we have S i C T\ Let j be maximal such that ^(F n ) C T j (¥ n ). 



are obvious. 



□ 



{Vk-l, ■ ■ ■ 



,Vj,a(v),v,Vj- 2 , ■ ■ -,v } 
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In particular, S i (¥ n ) ^ T j (¥ n ) and S i (¥ n ) \ T j+1 (¥ n ) ^ 0. Note that our choice of i and 
j guarantees that T j (¥ n ) \ S i (¥ n ) C S i ~ 1 (¥ n ) \ S i (¥ n ). Take v G T j (¥ n ) \ S i (¥ n ). By 
the choice of i and j, T j+1 (¥ n ) n ^(F 1 ) is a proper subspace of S^F 71 ). Since S i+1 (¥ n ) 
is a proper subspace of S i (¥ n ) as well, we get that (T^ +1 (¥ n ) n S i (¥ n )) U S i+1 (¥ n ) ^ 
S t (¥ n ) (a non-zero vector space is never a union of two proper subspaces). Take w G 
Si(¥ n ) \ ((T^' +1 (F n ) n S i (¥ n )) U S m (F n )). By the first statement of LemmaEl there exists 
a G S C T such that a(v) = w, but a(T^'(F n )) <f_ T^' +1 (F n ), as « G T^(¥ n ) and w G" T^' +1 (F n ) 
by the construction. This gives a contradiction and completes the proof. □ 

4 Isomorphism of maximal nilpotent subsemigroups 

In the present section we give a description of the fc-maximal nilpotent subsemigroups of 
M(n, F) for a fixed k up to isomorphism. 

Corollary 11. Let ¥ be infinite. Then every two maximal 2-nilpotent subsemigroups of 
M(n, F) are isomorphic. 

Proof. Clearly, \M(n, F)| = |F| in case of infinite F. Then, if a G ^(-T 7 ) we that 
Xa G ifiT) for all A G F and hence |F| < |<^(.F)| < \M(n,¥)\ = \¥\. Thus |p(.F)| = |F| 
and the statement follows. Now the statement follows from the fact that two semigroups, 

5 and T, with zero multiplication (i.e ah = for all a, b) are isomorphic if and only if 
\S\ = |T| since any bijection S \ {0} — > T \ {0} extends to an isomorphism via >— > 0. □ 

It is clear that the last statement is completely wrong if we replace "semigroup" with 
"algebra". This shows the difference between these two theories. The main reason for 
this difference is that in the case of the "algebra" structure there is a nice finite invariant: 
dimension. This invariant does not work in the "semigroup" case because vector spaces of 
different finite dimensions over an infinite field still have the same cardinality. 

Lemma 12. Let ¥ = ¥ q be a finite field, \¥ q \ = q = p l , where p is a prime. Let T and T' 
be two flags in ¥ n of length 2. The semigroups S = fiJ 7 ) and T = ^p{T') are isomorphic 
if and only if {dim(Vi), dim(V r 2 /V 1 )} = {dim(V / L / ), dim^'/V/)}. 

Proof. As F is finite, all semigroups we consider will be finite as well, so we can try to 
calculate their cardinalities. So, we assume dim(Vi) = m and have dim(V2/Vi) = n — m. 
Let B = {vi, . . . , v n } be an jF-basis of F n . An element, a G M(n, F), belongs to S if and 
only if a{vi) — 0, i — 1, . . . , m, and a{vi) = Y^T=i a j v h a j G F, i > m. Hence \S\ = g m ("- m ). 

If dim(V{) = m', we get \T\ = q m '^- m '). Further \S\ = \T\ implies q m ( n ~ m ) = q ™'(n-m>)^ 
which is equivalent to m(n — m) = m'(n — m'). The left hand side of the last equality 
is a quadratic polynomial in m, and the right hand side represents the value of the same 
polynomial in the point m'. This implies that there the equality holds if and only if m = m' 
or m = (n — m'). Now everything again follows from the fact that two semigroups, S and 
T, with zero multiplication are isomorphic if and only if \S\ = \T\. □ 
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We switch to the case of arbitrary F. The main result of this section is the following 
theorem. 

Theorem 13. Let T and T' be two flags in ¥ n of length r > 2. 

1. If ¥ is infinite and sig(jF) = (k, 1,1), k,l > 1, then the semigroups S = ^{J 7 ) and 
T = tpiT 1 ) are isomorphic if and only if sig(J-') = (k', 1, 1'), k', I' > 1. 

2. If ¥ is infinite and sig(jF) is different from (k,l,l), k,l > 1, then the semigroups 
S = v ? (^ r ) an d T = (f{J-') are isomorphic if and only z/sig(jF) = sig(jF'). 

3. If¥ is finite, then the semigroups S = v 9 (^ r ) an d T = v 9 (^ r ') are isomorphic if and 
only i/sigOF) = sig(.T). 

To prove this theorem we will need more notation and several lemmas. 

Let F be a field of an infinite cardinality 7 and V be a vector-space over F with a fixed 
basis, {ei\i = 1, . . . , n}. For v = Y^=i a i e i we se ^ ^ = ( a i? • • • ? a n) and denote by V the 
set of all 7^ f G V , such that — 1 for the minimal i for which a« 7^ 0. For v G V set 
l v = {Xv\\ G F*} and we have that V is a disjoint union of {0} and all l v , v G V. Because 
of our choice of 7 we have \l v \ = \V\ = 7. Moreover, \V\ = 7 if n > 1. 

Lemma 14. Let M = (^ij)i=i'"'t be a k x I matrix of rank 1 over ¥. Then there exist 
unique A G F* ; v G ¥ k and w e¥ l such that M = Xvw 1 . 

Proof. Let v' (resp. w') be a non-zero column (resp. row) of M, which exists, since M has 
rank 1. Then v' = X±v and w' = A 2 w for some Ai, A 2 G F, v G F fc and w G F'. Assume that 
i' (resp. f) is the number of the first non-zero coordinate of v (resp. w). Then, taking 
A = rrii'jf, we obviously get M = \vw l . □ 

Proposition 15. Assume that ¥ is infinite. Let S and T be some 3-maximal nilpotent 
semigroups of signature (k, 1, 1) and (m, 1, n) with k,l,m,n > 1 respectively. Then S ~ T. 

Proo/. Let ^ be the flag of F fc+m , stabilized by S and ^ be the flag of F m+n+1 , stabilized 
by T. Choose also an J^-basis, {e^}, in ¥ k+l+1 , and an J^'-basis, {/,-}, in F m+n+1 . Then the 
elements of 5 are matrices of the form 

v X \ 
w , 
/ 

where f G F fc , G ¥ l and X is a k x / matrix over F. Analogously, the elements of T are 
matrices of the form 

a Y 
0b 


where a G F m , b l G F™ and Y is an m x n matrix over F. We construct a bijection, 
(p : S — > T, in several steps. 
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First, we construct bijections ipi : ¥ k — > F m and ip2 '■ P ~ * ^ n a s follows: both ipi and ^ 
send to 0; then, as k, l,m,n > 1, the sets F', i = k,l, m, n, have the same cardinality and 
we can consider some bijections ip[ : F fe — > F m and ?/> 2 : F' —>■ ¥ m ; the latter uniquely extend 
to ipi and ^2 by the properties ipi(Xx) = Xipi(x), X <E ¥, x e ¥ k , and ^(Ax) = X^ix), 

X e F, x e ¥ l . 

Second, we decompose the set of all k x I (resp. m x n) matrices over F into a disjoint 
union of three subsets: {0}, M(l) and M(2) (resp. {0}, M(l)' and M(2)'), where the 
first set contains the zero matrix, the second one contains all matrices of rank 1 and the 
last one contains all other matrices. Since F is infinite, we have |M(1)| = |M(2)| = 
|Af(l)'| = |M(2)'|. Let ip 3 denote some bijection from M(2) to M(2)'. The last bijection 
1P4 : M(l) — > M(l)' is defined as follows: we take M G M(l) and use Lemma to write 
M = Xvw f for some A G F, v G F fc and w G F'; then we set ^(M) = Xipiiy)^^) 1 . 
Lemma [H] guarantees that ^4, as defined above, is a bijection. Let ip5 be the bijection 
between the sets of all k x I and m x n matrices, composed from ip3 and ^4. 

Now we define ip : S 1 — > T as follows: 



G T. 



Finally, we are going to prove that <p is a homomorphism. In S we have 





r 


V 






S 3 1 








w 






V 





; 







vw' 





Applying (p we get 



Mv) M*) \ ( ^ 5 (x') \ / ij 5 (vw') 

^ 2 (tw*)* ^K')' = 00 
00 / \ / \ 

and the left-hand side equals 

^i(t»)^ 2 K*)' 
00 
00 

Hence, we have to prove the equality ^(W) = ipi(v )ip2(w' t ) t . This equality is an equality 
on {0} U M(l)' and follows directly from the definition of ^4 (the M(l)-part of the map 
^ 5 ). This completes the proof. □ 

Proposition 16. Let 7\, T 2 be two isomorphic r -maximal nilpotent subsemigroups of the 
semigroup M(n,¥), r > 3, sig(Ti) = (i h i 2 , . . . , i r ) and sig(T 2 ) = (ji,j 2 , ■ ■ ■ ,>)■ Then 
h = it for allt = 2,...,r-l. 
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To prove this statement we will need some notation. Recall that a reflexive and tran- 
sitive relation, <, on a set, X, is called a preorder. A preorder, <, on X induces the 
equivalence ~ on X defined by: a ~ h if and only if a < b and b < a. Then the relation 
< becomes a partial order on the quotient set Xj ~. By the height (resp. depth) of the 
preorder < we will understand the height (resp. depth) of the induced partial order on 
X/ ~. 

Let T = tp(T) be an r-maximal subsemigroup in M(n, F) (here T is a flag of length r). 
For A, B G T we set A -< B provided that AC = implies BC = for all C G T, and we 
set A <C 5 provided that = implies = for all C G T. It is clear that both -< 
and <C are preorders. 

Lemma 17. i. A < B if and only if (V r -i H ker(A)) C (V r -i n ker(S)). 

T7ie set o/ a// maximal elements with respect to -< consists of all elements A G T 
sttc/i t/iat ker(A) D K r _i. 

5. T7ie set of all elements of depth i, i = 1,2, with respect to -< consists of all 
elements A such that dim(ker(v4) n = dim(l / r „ 1 ) — i. 

Proof. Let A -< B and suppose that there exists v G (K r -i H ker(A)) such that t> G" 
(K._iflker(5)). Since u G K-i, there exists C G T such that (t>) = Im(C). This guarantees 
AC = and BC ^ 0, a contradiction. That A ^ 5 follows from (V r -i H ker(A)) C 
(V r -i fl ker(5)) is obvious. This proves the first statement and the second statement 
follows directly from the first one and Lemma UJ 

Let A G Mi - Then ker(A) 7$ V r -\ by the second statement. Assume that dim(ker(74)n 
K-i) < dim(V^._i) — 1 and take arbitrary ^ v G K-i \ ker(A). Choose an jF-basis, {fj}, 
of F n , which contains v and a basis of ker(A) fl K-i; an d consider the linear operator B 
defined as follows: B(v) = 0, B(vi) = A(vi), Vj ^ v. It follows directly form the definition 
and the first statement that B G T and that A -< B, moreover, dim(l / r _i fl ker(B)) = 
dim(K-i n ker(A)) + 1. Hence ker(5) ^> K-i as dim(ker(A) n K-i) < dim(K-i) - 1, 
and thus B (jL Mq by the second statement. This implies that A G" M^, a contradiction. 
That all A such that dim(ker(A) fl V r -i) = dim(K r _i) — 1 belong to is obvious. This 
completes the proof for M± and the arguments for are similar. □ 

Lemma 18. 1. A < B if and only if ({V \ H Im(A)) D ((V \ Vi) n \m(B)). 

2. The set Mq - of all maximal elements with respect to <C consists of all elements A 
such that Im(_B) C V\. 

3. The set Mf- of all elements of depth i, i — 1, 2, with respect to <C consists of all 
elements A such that dim(Im(^4)) = dim(Im(A) D V{) +i. 

Proof. Analogous to that of Lemma [T7J with corresponding changes and consideration of 
images instead of kernels. □ 
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The main difficulty in the study of nilpotent subsemigroups in M(n, F) up to isomor- 
phism is that usual ranks of matrices are not preserved under isomorphisms. To improve 
the situation, we introduce the notion of a super rank (denoted by SupR), which we define 
in the following way. 

Denote K lfi = n M « and if ,i = n Mf. Consider the set M? n Mf and 
define the subset 

K 1A = {Ae M? n M<< : TAT ^ 0}. 

An element, A e M(n, F), is called indecomposable provided that A can not be decom- 
posed into a product of two elements from T. For an indecomposable element, A e M(n, F), 
we will write SupR(A) = 1 provided that A e if 1,1 U ifi ; o U if 0,1 ■ 

Define if 2 , = n M « and if , 2 = n M 2 «. Consider the set n Mf and define 
the subset 

K 2A = {Ae n M<< : TAT ^ 0}. 
Consider the set M± fl Mf* and define the subset 

K lt2 = {Ae n M 2 « : TAT ^ 0}. 

Consider the set M 2 H Mf* and define the subset 

K %2 = {Ae M 2 n M 2 « : TAT ^ and TAT ^ TBT for all 5, SupR(5) = 1}. 

For an indecomposable element, A e M(n, F), we will write SupR(A) = 2 provided 
that A E if 2,0 U #0,2 U if 2,1 U ifi, 2 U if 2)2 . 

Lemma 19. Let T\ and T 2 be two isomorphic semigroups of signatures (ii,...,i r ) and 
(ji, . . . ,j r ) respectively and ip : Ti T 2 be an isomorphism. Let A e T\ be an indecompos- 
able element of super rank i, i = 1,2. Then <f(A) is an indecomposable element of super 
rank i, i = 1,2, respectively. 

Proof. Follows from the fact that isomorphism preserves indecomposable elements and the 
sets if u ,„, where < u, v < 2. □ 

Recall that for a semigroup, S, the notation S 1 denotes either S provided that S has the 
identity or the semigroup S'Ujl} in the opposite case. Our main aim in the following lemma 
is to describe the super ranks for indecomposable elements in terms of the multiplication. 

Lemma 20. Let A e T be an indecomposable element and T 1 AT 1 7^ {A, 0}. 

1. SupR(A) = 1 if and only if there exists an element, B G T , of (usual) rank 1, such 
that CAD = CBD for all C,D^T l , where either C^l orD^l. 

2. SupR(A) = 2 if and only if SupR(A) 7^ 1 and there exists an element, B e T , of 
(usual) rank 2, such that CAD = CBD for all C,D e T l , where either C 7^ 1 or 
D^l. 
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Proof. We prove the first statement and the second one is analogous. Let A = (ajj) be an 
indecomposable element with SupR(A) = 1. We start with the necessity. 

Let {vi} be an J^-basis of F n . If A E K lfi then M E M± and M E Mf. From 
Lemmas fT71 and [18]we get dim(ker(A) n K-i) = dim(V^._i) — 1 and Im(yl) C V\. Consider 
the element B E T, defined as follows: B(vi) = A(vi), i < dim(K_i), and B(vi) = in 
other cases. From dim(ker(v4) n K-i) = dim(l / r _ 1 ) — 1 it follows that rank(B) = 1 and it 
is obvious that CAD = CBD for all C,D E T 1 such that either C / 1 or D ^ 1. 

The case A E K Q) i can be handled by analogous argument. Hence we consider the 
remaining case A E Ki \. From Lemmas fT71 and [T8lwe get dim(ker(A)nK r -i) = dim(V r -i) — 
1 and dim(Im(A)) = dim(Im(A) fl Vi) + 1. Let {vi} be an jF-basis of F n . Consider the 
element B E T, defined via B{yi) = A(vi), dim(l / 1 ) < i < dim(V^._i), and B{yi) = in 
other cases. Already the condition dim(ker(y4) fl V r -\) = dim(V A r _i) — 1 guarantees that 
rank(B) < 1 and the condition TAT ^ guarantees rank(B) > 0. Therefore rank(B) = 1 
and one easily gets CAD = CBD for all C,D E T 1 such that either C / 1 or D / 1. This 
completes the proof of the necessity. 

Let A,B E M(n, F) be such that T 1 AT 1 {A,0}, rank(B) = 1 and CAD = CBD 
for all C, D E T l such that either C ^ 1 or D / 1. Then we have ker(v4) fl V T -\ = 
ker(5)ny r _i andIm(^)\(Im(^)nVi) = lm(B)\(lm(B)nV 1 ). Hence dim(ker(A) DK-i) = 
dim(ker(5) nK-i)- Since rank(B) = 1, we get that either dim(ker(A) flK-i) = dim(V r _i) 
and hence A E Mq or dim(ker(A)fl V r -i) = dim(V r _i) — 1 and hence A E M^. Analogously 
one gets A E or A E Mf. If A E H Mf then rMr 1 ^ {A, 0} guarantees that 
A E Kn. This completes the proof. □ 

Proof of Proposition \Th\ Fix 1 < s < r. For i = 1, 2 consider the following sets: 

Ti{s) = {AeT, : T^ATl" 3 + and SupR(A) = 1}, 
ffa) = T[~ s fl {B E Ti : T s ~ l B + 0}. 

Let ip : Ti — > T 2 be an isomorphism. It follows from Lemma [T9l that ip(Ti(s)) = T 2 (s). 
Denote by u(i), i = 1,2, the minimal positive integer for which there exists a subset, 
T/(s) C Tj(s), such that |27(s)| = u{i) and for all B E Tj(s) there exists C E T/(s) such 
that CB ^ 0. It is clear that u(l) = u(2) and to complete the proof it is enough to show 
that u(l) = i s . 

First we show that u(l) > i s . Indeed, let H = {Ax, . . . , Aj} C T,(s) and j < i s . 
Using Lemma |2"U| we can find the elements Bi, . . . , Bj such that rank(Bi) = 1 for all I and 
CA t D = CB { D for all C, D E T\ where either C / 1 or D / 1. But then the rank of 
arbitrary linear combination of B^s does not exceed j < i s . Since dim(V^/V^_i) = i s > j 
we get that there exists v E V s \ V s -\ such that Bi(v) = for all /. This means that 
A X C = BiC = for all I if C E T[~ s such that Im(C) = (v). As T s ~ l C = and hence 
C E Ti(s), we get that H does not satisfy the necessary conditions. 

Finally, one can construct a subset, H C Tj(s), such that \H\ = i s and for all B E Ti(s) 
there exists C E H satisfying CB ^ 0, in the following way: let ^ v E V s -\ and 
{vi, . . . ,Vi g } be arbitrary elements from V s , which are mapped onto a basis of V s /V s -i 
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under the canonical projection. Extend {i>i, . . . , v is } U {v} to an jF-basis, B say, of F n . Let 
A u I — 1, . . . , i s , be elements of rank 1 in M(n, F), defined via A;(t>;) = v and A;(u>) = 
for all w G B\{vi}. It is obvious that the set H = {A±, . . . , A is } C T satisfies the necessary 
condition. This completes the proof. □ 

To proceed we will need the following lemma. 

Lemma 21. Let V and V be two vector spaces over a field. Let V(2) and V'(2) denote 
the sets of all subspaces of V and V respectively, whose dimensions do not exceed 2. // 
1/(2) and V'{2) are isomorphic as posets with respect to inclusions then d\mV = dimV . 

Proof. It is enough to show that the poset of all subspaces of V (with respect to inclusions) 
can be reconstructed from V(2). To characterize 3-dimensional subspaces we remark that 
every such a subspace is determined by some 2-dimensional subspace, a say, and some 
1-dimensional subspace, / say, such that I <£. a. In other words, every pair (a, I), I (£. a, 
defines a 3-dimensional subspace, which we will denote by (a, I), abusing notation. A 1- 
dimensional subspace, m, is contained in (a, I) if and only if there exists a 1-dimensional 
subspace, k, contained in a, such that m is contained in the two-dimensional subspace, 
generated by k and /. Hence we can characterize all 1-dimensional subspaces in (a, I) only 
in terms of elements from V(2). A 2-dimensional subspace k is contained in (a, I) if and 
only if all 1-dimensional subsets of k are contained in (a, I). A subspace k is contained in 
a subspace m if and only if all 1-dimensional subsets of k are contained in m. This implies 
that all subspaces of V of dimension at most 3 and their inclusions can be characterized 
only in terms of elements from V(2) and their inclusions. Hence the poset V(2) completely 
determines the poset V(3) or all subspaces of V of dimension at most 3 with respect to 
inclusions. The proof is now easily completed by induction. □ 

Let 7^ A G T be a decomposable element. We will say that the super rank SupR(A) = 
1 if there exists a decomposition, A — A ± A 2 . . . Ai, of A into a product of indecomposable 
elements and j e {1,...,/} such that SupR(A,-) = 1. We will say that the super rank 
SupR(A) = 2 if SupR(A) 7^ 1 and there exists a decomposition, A = A\A 2 ... Ai, of A into 
a product of indecomposable elements and j e {1, . . . , 1} such that SupR(Aj) = 2. 

Lemma 22. Let A e T be decomposable. 

1. rank(A) = 1 if and only if SupR(A) = 1. 

2. rank(A) = 2 if and only ifSupR(A) = 2. 

Proof. Let SupR(A) = 1, A = A X A 2 . . . A x and j e {1, ...,/} be such that SupR(A,) = 1. 
Let B be the element of rank 1 such that CAjD = CBD for all C,D G T 1 , where either 
C ^ 1 or D ^ 1. Then A — A 1 ... Aj^BAj+x . . . A x and hence rank(A) < rank(B) = 1. 
That rank(A) = 1 now follows from A ^ 0. 

Conversely, let rank(A) = 1 and let A = A\A 2 ...Ai be a decomposition of A into 
indecomposable elements from T. Let v be a non-zero element in Im(A) and {vi} be an 
jF-basis of F n , such that v G {vi}. Consider the linear operator B, defined as follows: 
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B(v) = v and Biyi) = 0, ^ u. Then A = . . . = BA X A 2 . . . A t and rank(B) = 

rank(BA{) = 1. Moreover, from the construction of 5 it follows immediately that BA\ £ 
T. If £L4i is indecomposable, we get rank(BAi) = 1 and T X BA\T X 3 A and hence does 
not coincide with {BAi,0}. This implies SupR(£Mi) = 1. Otherwise we can substitute 
the element A by the element BA\ and apply the same arguments. This procedure will 
certainly stop after not more than n steps, since T is a nilpotent semigroup of nilpotency 
degree < n (see Corollary E]) • 

The proof of the second statement is analogous. □ 

Proof of Theorem\T^ Let 7\ and T 2 be two r- maximal nilpotent subsemigroup in M(n, F). 
Assume that sig(Ti) = (ii, . . . , i r ) and T : = Vo C V\ C . . . be the corresponding flag in 
F n . Assume that sig(T 2 ) = (ji, . . . ,j r ) and T : = W C W% C . . . be the corresponding 
flag in F n . The strategy of our proof is to show that all i s can be characterized in terms of 
some invariants, preserved under any isomorphism. If r > 3 and 1 < s < r, this was done 
in Proposition [161 Hence here we have to consider only remaining cases. 

Case 1. i\,i r , Y7 S =2 ^ — 2- Then it is easy to see that for every V C Vi, dim(V') = 2, 
there exists a decomposable element, A, of rank 2, such that Im(A) = V. Let ip : T\ — > T 2 
be an isomorphism. Denote by Ann(Ti) the two-sided annihilator of T\. First we remark 
that the inequality YH=2 ^ — ^ implies that for a fixed i — 1, 2 and for A,B £ Ann(Ti), 
rank(A) = rank(B) = i, the condition Im(A) = Im(i?) is equivalent to the existence of 
C, rank(C) = i, such that A = CD\ and B = CD 2 for some D\ and D 2 . In particular, 
for this C we will have Im(C) = Im(v4) = lm(B). Hence, lm(A) = lm(B) is equivalent 
to lm(<p(A)) = lm((f(B)). Now from Lemmas [22l and [T9l it follows that dim(Im(</?(A))) = 
dim(Im(A)). 

Let A, B be two elements from Ann(Ti), rank(A) = 1, rank(B) = 2. Then it is easy 
to see that Im(A) C lm(B) is equivalent to the condition that for arbitrary decomposition 
B = CD\, with C indecomposable and SupR(C) = 2, there exists D 2 such that A = CD 2 . 
This implies that Im(A) C lm(B) is equivalent to lm(ip(A)) C lm(ip(B)). Hence ip induces 
an isomorphism from the partially ordered set of all subsets of dimension < 2 in V\ to the 
partially ordered set of all subsets of dimension < 2 in W\. Now Lemma [211 guarantees 
dim(yx) = dim(W^). 

Case 2. Y7 S =2 — ^ anc ^ = ^- This situation is obviously characterized by the fact 
that K 2) o = 0- Hence — \ implies j\ = 1. Moreover, going to the opposite semigroup, 
we also get i r = 1 implies j r = 1 in the case ^^=2 ^ — 2- 

Case 3. r = 3, z 2 = 1 and z'i = 1. This case is characterized by the fact that there exists 
an indecomposable element, A, such that SupR(A) = 1 and AT contains all decomposable 
elements. Hence in this case we get j\ = 1. Analogously i 3 = 1 implies j 3 = 1. 

Case 4. r = 3, i 2 = 1, i\,t3 > 1 and F is infinite. From previous cases we get that 
ji, ja > 1 as well. By Proposition [T5l T 2 ~ T\ for arbitrary ji, j 3 > 1. 

Case 5. r = 3, i 2 — 1, «i, «3 > 1 and |F| = q = p l < 00. One easily calculates that the 
number of decomposable elements in Ann(Ti) (ii x ^-matrices of rank < 1) equals q^+'s-i. 
Hence, the number of indecomposable elements in Ann(Ti) (i\ x z 3 -matrices of rank > 1) 
equals q %1+13 — g*i+*3-i_ Hence T\ ~ T 2 implies q %1+%3 — g*i+*3-i — qh+h _gii+i3-i an( j f rom 
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ii + i 3 = ji + j 3 = n — 1 we get i\i s = jij 3 . Further, one can easily see that the number 
of elements in the right annihilator of T\ equals g Jl (* 2+l 3). From 7\ ~ T 2 we get g* l( * 2+ *3) = 
qhih+h) anc ^ finally, from i 2 = j 2 and from i\i 3 = j\j 3 we derive i\ = j\. This also implies 
^3 = J3 an d completes the proof. □ 

Careful analysis of the proof above shows that, in fact, the following statement is true. 

Corollary 23. Let r > 3 and T 1; T 2 be some r -maximal nilpotent semigroups (possibly in 
different M(i, F) ). Then T\ ~ T 2 if and only if sig(Tx) = sig(T 2 ). 



5 Appendix: Isolated and completely isolated sub- 
semigroups (in the case of a finite F) 

For i — 0, . . . , n we denote by Di the set of all A G M(n, F) such that the rank of A equals 
i. The sets Di, i — 0, . . . , n, constitute an exhaustive list of P-classes in M(n, F), see [Ok2, 
Chapter 2]. For i = 0, . . . ,n we also denote by Ii the two-sided ideal D U • • ■ U Di of 
M(n, F). We start with the following lemma, which we will often use in the sequel. 

Lemma 24. For every positive integer k, 1 < k < n — 1, the ideal Ik is generated as a 
semigroup by D^. 

Proof. Let S = (Dk). Since Ik = Uj<kDj, by inductive arguments it is enough to show that 
Dk-i C S. Let A e £> fc _i, V x = lm(A), V 2 = ker(A). Then dim(ker(A)) > 2. Let v 1 ,...,v i 
be a basis of ker(v4), v . . . , v n a basis of Im(v4), and w i+ i, . . . , w n be arbitrary such that 
Vj = A(vjj), j > i. Note that this implies that Wj+i, . . . , w n are linearly independent and 
vi, . . . , Vi, Wi+i, . . . , w n form the basis of F". Choose further two arbitrary elements w, u, 
such that dim((w, u, Vi)) = dim(Vi) + 2. Note that i = n — k + 2>2by choice of k. Define 
the linear operator B\ as follows: B^ivi) — 0, I = 1, . . . , i — 1; -Bi(fj) = w; Biiwi) = v h 
I > i. Let B 2 be a linear operator of rank k, satisfying B 2 {u) = u, B 2 {w) = 0, B 2 {yi) = v h 
I > i. Clearly such B 2 exists and -B2-B1 = A. This completes the proof. □ 

Recall that a subsemigroup, T, of a semigroups, S, is called completely isolated provided 
that xy G T implies x G T or y G T for arbitrary x,y E S. Further, T is called isolated 
provided that x n G T implies x G T for every x G S*. 

Proposition 25. Assume that F is finite. Then the only completely isolated subsemigroups 
ofM(n,¥) areM(n,¥), GL(n, F) and 7 n _i = M(n, F) \ GL(n, F). 

Proof. It is obvious that the subsemigroups M(n, F), GL(n, F) and Z„_i are completely 
isolated. Let S be a completely isolated subsemigroup of M(n, F). The semigroup 5* n 
GL(n, F) is finite and hence must contain an idempotent provided that it is not empty. 
Since GL(n, F) contains only one idempotent we get that either S D GL(n, F) or S fl 
GL(n,F) = 0. 

Assume that S fl I n -\ 7^ 0. By Lemma 1241 J n _i is generated by -D n -i- Hence every 
element from S fl I n -\ can be written as a product of elements from D n _i. Since S is 
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completely isolated, we conclude that S PI D n _ x is not empty. Let A G S PI D n -i- F° r 
every 5 G £> n _i there exist C, D E GL(n,F) such that A = CBD. If 5 D GL(n, F) 
then S = C _1 y4D _1 G 5. Otherwise B £ S because S is completely isolated. Thus 
S D D n _i. This means that 5 D J n _i = M(n,F) \ GL(n,F) by Lemma El and the 
statement follows. □ 

Let A and B denote some non-empty sets of n — 1-dimensional and 1-dimensional 
subspaces in F n respectively. Assume that V\ (jL V 2 for every V\ G B and every V2 G A. Set 

S^B) = {A G M(n, F) : lm{A) G „4,ker(A) G B}. 

Lemma 26. For even/ ^4 and B as above the set S(A, B) is an isolated subsemigroup in 
M(n, F). 

Proof. Let A, B G S(A, B). Since Im(S) H ker(A) = 0, we get that ker (AB) = ker(B) and 
Im(AB) = lm(A). This means that AB G 5(^4, B) and thus S(A, B) is a subsemigroup in 
M(n, F). 

Let A G M(n, F) be such that A k G 5(^4, B) for some positive integer k. Then 
rank(A h ) = n — 1 and hence rank(A) = n — 1. This implies ker(A) = ker(74 fc ) G £> 
and Im(A) = Im(A fc ) G ^4. Therefore A G S(A,B), which completes the proof. □ 

For any decomposition F n = V\ © V2, we denote by e(Vi,V2) the uniquely defined 
idempotent from M(n, F), which represents the linear operator of projection on V\ along 
V 2 . Note that the set of all possible e(Vi, V2) constitute an exhaustive list of idempotents 
in M(n, F). 

Lemma 27. Lei F 6e finite and S be an isolated semigroup in M(n,¥). Assume that one 
of the following conditions is satisfied: 

1. S contains 0. 

2. S contains two idempotents e(Vi, V2), e(V{, V£) of rank n — 1, such that V2 C V{. 

3. S contains some idempotent of rank < n — 2. 
Then S D I n -i- 

Proof. First we consider the case when S contains 0. Since S is isolated and contains 0, it 
must contain all nilpotent matrices. Let V\ and V2 be two non-trivial subspaces in F n such 
that F n = V\ © V2. Choose a basis, Vx, . . . , Vi, of V\ and a basis, fj+i, . . . , v n , of V2, and 
consider the linear operators A and B defined as follows: A(vj) = j = 2, . . . , i + 1, 
A(vj) = otherwise; B(vj) = f j+i, i = 1, • • • , i, B(vj) = otherwise. Clearly, both A and 
B are nilpotent and hence are contained in S. Thus S 3 AB = e(yi,V 2 ), which means 
that S contains all non-invertible idempotents. Since for a finite F some power of every 
element in l n -\ is an idempotent, we finally get that S D I n -x- 

Now we consider the case when S contains two idempotents e(Vi, V2), e(V{, V 2 ) of rank 
n — 1, such that V 2 C V[. Because of the first part of the lemma proved above it is enough 
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to show that S contains 0. Let V\, . . . , t> n _i be a basis of V{, such that t> n _i is a basis of V 2 , 
and let v n be a basis of V 2 . Consider the linear operator A defined as follows: A{vi) = v i+ i, 
i < n - 1, A(v n -i) = vi and A(v n ) = 0. Then A n ~ l = e(V{, V 2 ) G S and hence A G S, 
since S is isolated. Therefore Bi = A l e(Vi, V^A™ -1- * G S for every i — 1, . . . ,n — 1. But 
Biivj) = Vj, j 7^ n, i, and Bi(v n ) = Bi{vi) = 0. Hence = -B1-B2 . . . £> n -i G 5 1 . 

Finally, we consider the case when S contains some idempotent of rank < n— 2. Because 
of the second part of the lemma proved above it is enough to show that S contains two 
idempotents, say e, /, of rank n — 1, such that ker(e) G Im(/). Let e(Vi, V2) G S be a 
non- invert ible idempotent and dim(V2) > 2. Choose a basis, t>i, . . . of V\ and a basis 
of V 2 , and consider the linear operators A and S defined as follows: A(vj) = Vj, 
j < i, A(v i+1 ) = 0, A(vj) = Vj-x, j > i + 1; = « j} j < i, B(v n ) = 0, S^) = v j+1 , 

j = i + 1, . . . , n - 1. Then A dim ( ya ) = 5^^) = e (Vl, V 2 ) G 5 and thus A,B e S as S 
is isolated. But this means that AB, BA G S. But both Ai? and B A are idempotents of 
rank n — 1 and by construction ker(A5) = (u n ) C Im(i?A). This completes the proof. □ 

Theorem 28. Assume that ¥ is finite. Then the only isolated sub semigroups of the semi- 
group M(n, F) are M(n, F), GL(n, F), l n -\ and all semigroups S(A, B), where A and B are 
some non-empty sets of n — 1-dimensional and 1-dimensional subspaces in ¥ n respectively, 
such that V\ <f_ V 2 for every V\ G B and every V 2 G A. 

Proof. Since every completely isolated subsemigroup is isolated, it follows from Lemma [261 
that all the semigroups listed above are indeed isolated. Let now S be an isolated semigroup 
of M(n, F). By the same arguments as in Proposition [25], we get that either S D GL(n, F) 
or S PI GL(n, F) = 0. We consider these two cases separately. 

Case 1. S D GL(n, F). If S = GL(n, F), we are done. So, we can assume that 
S R J„_i 7^ 0. Then S fl D\~ 7^ for some k and hence S D -Dfc since 5 D GL(n, F). 
Lemma EH now implies S D Ik, in particular, S 3 0. Thus S 1 D J n _i by Lemma [271 and we 
get = M(n, F) in this case. 

Case 2. S" D GL(n, F) = 0. Then S 1 contains a non-invertible idempotent. If S 
contains an idempotent of rank < n — 2, then S D J„_i according to Lemma [2T1 and thus 
S = I n -\- Hence we can now assume that all idempotents of S have rank n — 1. Let 
.E(S') = {e x , . . . , e m } and set A = {Im(ei), . . . , Im(e m )}, B = {ker(ei), . . . , ker(e m )}. From 
Lemma [271 it follows that ker(ej) <£_ Im(ej/) for all j,j'. Let V\ G A and e a G E(S) be 
such that V\ = Im(e a ). Let V 2 G B and ep G ^(S 1 ) be such that V 2 = ker(e^). Then 
lm((e a epY) = V\ and ker((e Q ,e ( g)*) = V 2 for all i, in particular, for that i, for which the 
element (e a epY belongs to E(S). This proves that E(S) 3 e(Vi,V 2 ) for all V\ G A and 
all y 2 G B. Take now arbitrary A G Since ^ G E(S(A,B)) = E(S) for some 

i, we get that A e 5 and hence S 3 S(A,B). On the other hand, the fact that S(A,B) 
is isolated says that A G" S(A, B) implies that the corresponding idempotent A % can not 
belong to E(S) = E(S(A, £>)) since either Im(y4 ? ) G" A or ker^*) G" i3. From this we derive 
S = S(A, B) and complete the proof. □ 
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